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The Pearson correlation coefficient is commonly used for quantifying the global level of degree- 
degree association in complex networks. Here, we use a probabilistic representation of the underlying 
network structure for assessing the applicability of different association measures to heavy-tailed de- 
gree distributions. Theoretical arguments together with our numerical study indicate that Pearson's 
coefficient often depends on the size of networks with equal association structure, impeding a sys- 
tematic comparison of real-world networks. In contrast, Kendall-Gibbons' Tb is a considerably more 
robust measure of the degree-degree association. 
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I. INTRODUCTION 

In many scientific fields, ranging from biology to so- 
ciology and engineering, network studies have recently 
brought substantial insights into the underlying connec- 
tivity patterns of different systems [IH3] . Going beyond 
characterizing the network topology by the essential de- 
gree distribution [4], extensive research has focused on 
degree-degree correlations [5J [3]. A positive degree- 
degree correlation implies that nodes with a similarly 
small or large degree tend to be connected to each other. 
A negative degree-degree correlation accordingly indi- 
cates that the nodes tend to be connected to nodes with 
a considerably different degree. In the statistical physics 
community, the global level of correlation is commonly 
quantified by the Pearson coefficient r [5j. However, 
there is a substantial drawback of this measure; its value 
strongly depends on the network size and might even 
vanish for large networks, as recently shown in [5] . 

In this Brief Report, we apply bivariate distributions 
and different association measures from the field of statis- 
tics to describe and quantify the structure of networks. 
The term "association" (or "dependency") as used here 
refers to the general relation between two random vari- 
ables [5], while the term "correlation" is restricted to a 
single measure [10 . Both theoretical arguments and our 
numerical study indicate that, regarding the size of net- 
works with a heavy-tailed degree distribution, Kendall- 
Gibbons' tj, is a considerably more robust association 
measure than the Pearson coefficient r. 

In the following, we introduce the concept of the prob- 
ability matrix as an application of bivariate distribu- 
tions to networks. We then provide an overview of im- 
portant association measures for bivariate distributions. 
Their suitability to quantify degree-degree associations 
in heavy-tailed networks is discussed in theory and nu- 
merically investigated. 



II. REPRESENTING DEGREE-DEGREE 
ASSOCIATION BY A PROBABILITY MATRIX 

The total number of edges being connected to a node 
is usually called degree and is denoted by k. However, 



the adequate representation of the degree-degree associ- 
ation requires the distribution of the number of edges h 
connected to the end of an edge, including the considered 
edge itself. These integer numbers are realizations of the 
random variables symbolized with the capitals K and H . 
It is H = K for a specific node, except for K = 0. The 
different assignment is illustrated in Fig. [T] We denote 
by Pk(k) the distribution function of K, which alterna- 
tively can be written as Pk{K = k) and corresponds to 
the probability that a random variable K has the value 
of realization k. The random variable H has the distri- 
bution function Ph(h). The functions Pk(k) and Ph(h) 
are related by 



P h {h) = P k {h)h/(k), 



(k)<(h), 



(1) 



(2) 



where (k) is the expectation of K, being different to the 
expectation (h) of the random variable H. 

Each edge has a realized pair of H, as depicted in Fig. [I] 
with the exemplary pair {h,h r ) = (4,3). The distribu- 
tion of these pairs can then be described by the "prob- 
ability matrix" P(h,h!), which corresponds to the joint 
distribution introduced in |11) . The probability matrix 
differs to common bivariate discrete distributions of ran- 
dom variables, as each realization of H occurs H times 
at a node and is in H pairs (H,H ! ). Furthermore, each 
pair (H, H') has a twin (H' , H) in case of a network with 
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FIG. 1. Different assignment of the number of edges, (a) K 
edges per node, (b) H edges connected to the end of an edge. 
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undirected edges. Nevertheless, we treat P(h, h') as a 
common bivariate discrete distribution, assuming that 
the differences are negligible. It should be noted that the 
balance condition formulated in [15] still holds, whereby 
the distinction between h and k allows describing the re- 
lations given by Eqs. and ([2| in a statistically correct 



III. ASSOCIATION MEASURES FOR 
DISCRETE RANDOM VARIABLES 

Different measures of association are presented here for 
general pairs of discrete random variables {X, Y), as they 
are related to any bivariate distribution. These variables 
correspond to (H, H') in networks (see Fig.0. The as- 
sociation of a given pair (X, Y) is fully described by its 
bivariate distribution P(x,y), which is not directly com- 
parable to the association of other pairs of random vari- 
ables. Therefore, different measures have been developed 
allowing to compare two different association structures 
by a simple inequation. Each measure is based on a dis- 
tinct definition, fulfilling a set of properties [TU]. Firstly, 
the association measure is normalized so that its abso- 
lute value is not larger than 1. Secondly, the measure 
should be if the two variables are independent and the 
absolute value should be equal to 1 in order to denote 
perfect association. Lastly, every observation in a sam- 
ple should have the same weight in the computation of 
an association measure. 

The commonly used measure for the degree-degree as- 
sociation in networks is the Pearson coefficient r [TU] , 
written in its general form as 



Pp = 



(XY)-(X)(Y) 



y/((X*)-(X)*)((Y*) -(Y)*) 



(3) 



The association is said to be positive if r > and negative 
if r < 0. Pearson's coefficient is estimated by replacing 
the moments of X and Y with their estimations. The 
confidence interval for an estimation of r depends on the 
distribution type of X and Y. 

Another important association measure is Spearman's 
rank correlation coefficient p s . For continuous random 
variables p s is formulated similarly to p p by replacing in 
Eq. ([3} the variables X and Y with F(X) and F(Y), 
being the cumulative distribution functions (CDF). In 
order to estimate p s for discrete random variables the 
CDF are replaced by the rank numbers of the ordered 
samples of X and Y, respectively. An ordered sample of 
n observations Xi is {X\ < X2 < ... < X{ < ... < X n ). 

Kendall-Gibbons' r\, [13] and Goodman-Kruskal's -f g 
[14j are two important association measures based on 
concordance. Two pairs (X,Y) and (X',Y') are con- 
cordant if X > X 1 and Y > Y f , or X < X 1 and Y < Y' . 
The pairs are dis-concordant if X > X' and Y < Y' , or 
X < X' and Y > Y' . Pairs with equal X and pairs with 
equal Y are called tied pairs. Kendall-Gibbons' T& for a 



sample of discrete random variables (X, Y) is given by 
U = 2(n c - n d )/^j[n{n - 1) - £J [n(n - 1) - £ y ], (4) 

where £ x = ^ i rn x (i)(rn x (i) — 1) with m x (i) as the 
number of observations X = i. Accordingly, £ v = 
Si m y W( m yW — 1) with m v (i) as the number of ob- 
servations Y = i. The term n c denotes the number of 
concordant pairs 

^max — 1 ymax— 1 [ ^max ^max 

i=Vin 5=Jmm I x'=x+l y'=y+l 

and rid stands for the number of dis-concordant pairs 
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x' — 3; m i n y'— y m in 



(6) 

where m x>y denotes the number of observations with 
X = x and Y = y. The symbols x' and y' are writ- 
ten for x and y in order to distinguish the different pairs 
of observations. If the bivariate distribution P{x, y) with 
its marginal distributions P x (x) and P y (y) is given, t\, 
can be calculated as 



n = 



2(n c - n d ) 



\ 



i-E p ^) 2 ) (i-E^) 2 ) 



(7) 



where n c and n d are derived by Eqs. ^ and ^ after 
replacing m X)2/ by P{x,y). The bivariate distribution, 
in turn, can be estimated as Pix, y) — rn x y /n. The 
estimation of Kendall-Gibbons' by using Eq. Q is 
equivalent to using Eq. Q. Modifications of t\, (e.g.. 
[131 HB] ) are not considered in the scope of this Brief 
Report. Using the same notation, Goodman-Kruskal's 
7 ff is calculated as 



l g = (n c - n d )/(n c + n d ). 



(8) 



It should be noted that in contrast to Pearson's coefficient 
the concordance based measures are independent of the 
marginal distributions P x (x) and P y (y) [17]. Hence, a 
transformation of the random variables does not influence 
the value of r& and j g . Further association measures are 
given in |10) . 



IV. APPLICABILITY TO NETWORKS 

The applicability to networks is discussed only for 
Kendall-Gibbons' t/, and for the Pearson coefficient r. 
Spearman's p s is not further considered here as the rank 
of H with H=l,2,3,... is equal to H or is a linear trans- 
formation thereof. Hence, the values of p s do not sig- 
nificantly differ from those of r. Goodman-Kruskal's 7 S 
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does not consider all observations (h, hf) with the same 
weight (tied pairs are neglected) and therefore is not an 
adequate measure for the degree-degree association. 

The variable H of real-world networks often follows a 
heavy-tailed distribution [2 . The typical discrete dis- 
tribution exhibiting such heavy-tail characteristics is the 
Zipf distribution. Its probability function is written as 



P(h) = h-y h > °) 7 > o. 

h=l 



(9) 



where the maximum degree h max can be both bounded 
or unbounded. The Zipf distribution is the discrete case 
of the continuous Pareto distribution [IS] . Both distri- 
butions have no variance and second moment (h 2 ) for 
7 < 2. Additionally, if the exponent is 7 < 1 there 
is no expectation (h). Therefore, the theoretical argu- 
ments against the application of the Pearson coefficient 
r to continuous heavy-tailed distributions (e.g., [H?l [217] ) 
hold likewise for discrete heavy-tailed distributions. For 
instance, r is not defined for 7 < 2. In contrast, Kendall- 
Gibbons' Tf, is independent of the marginal distributions 
(see Sec. |III[ ) and hence independent of 7. Furthermore, 
Lindskog [21] stated that for the class of elliptical dis- 
tributions the estimation of r has a lower performance 
than the estimation of Kendall's r (being the continu- 
ous case of Kendall-Gibbons' t^), which indicates another 
drawback of Pearson's coefficient. Furthermore, the con- 
fidence interval for an estimation of r again depends on 
the marginal distribution, whereas the confidence inter- 
vals for an estimation of can be constructed universally 

We complement the theoretical discussion by numer- 
ically studying the behavior of both the Pearson coeffi- 
cient r and Kendall-Gibbons' with respect to heavy- 
tailed distributions of H. Thereby, a focus is set on 
the dependence of the measures on the maximum de- 
gree h max , while maintaining the association structure. 
With an increasing h max the measures should converge 
to a constant value. The convergence behavior thus can 
be taken for a practical evaluation of the fitness of the 
association measures. Three symmetric bivariate distri- 
butions are used for generating the probability matrix 
P(h, h'). The first type is the mixed truncated Zipf dis- 
tribution, which represents a mixture of the independent 
and the perfectly associated case of the Zipf distribution. 
The independent case is [TU] 

p^h, hf) = p h (h)p h {ti) = (hh')-y ]T E i hh ')~\ 



h' = l h=l 



and the perfectly associated case is 



(10) 



h—f/ h' 1 for h = ti, 
r. 2 [h.h') = { h=i (11) 

' for h ^ ti . 



The mixing of these two cases is then given by 

P(h,h') = h A(W + ^(M')(i-*) ; (12) 

ff p x (h, h')t + p 2 (h, h 1 ) (1 - 1) 

h=l h'=l 

with the mixing function t = amax.(h,h')~ c and < 
a < l,c > 0. If c = 0, then the mixing is simple and 
the Pearson coefficient becomes r = 1 — a [23]. For the 
second type the multivariate Zeta distribution according 
to Yeh [24] is used, with its survival function F 

F{h,ti) = [l + (a(h-l)f + {a(h'-l)f) r ',h> 1. (13) 

The probability matrix can thus be written as 

P(h, ti) = l- F(h, 1) - F(l, h') + F{h, h!), (14) 

being normalized for the truncated case by the sum of 
P(h,h!) with h < h max . For the last type we apply a 
continuous Pareto distribution for the marginal distri- 
butions and a negatively associated bivariate exponen- 
tial distribution [25] to construct (negative) association 
structures. The resulting cumulative distribution func- 
tion F is formulated as 

F(h, h') = l-(h+ 1)~ 7 - (hf + ly 

+ ((h + l)(ti + l))-t e -l 2 ein(h+l)ln{h' + l) 

(15) 

and P(h, h') can then be calculated as 

P(h, h') = F(h, hf) + F(h -l,h'- 1) 

-F(h,ti -l)-F(h-l,h'), (16) 

being normalized again as h < h max , so that the sum of 
P(h, h') equals 1. 

Based on these three types of probability matrices, the 
Pearson coefficient r and Kendall-Gibbons' r& have been 
determined for different distribution parameters and dif- 
ferent maximum degrees h max . The resulting values are 
reported in Fig. [2] Kendall-Gibbons' n converges faster 
to a constant value in case of the positive association of 
both the Zipf and the Zeta distribution [Fig. 2 (b)-(f)]. 
Pearson's coefficient is only slightly more stable in the 
specific case of the Zipf distribution with c = [Fig. 2 
(a)]. In case of the negative association given by the 
probability matrix based on the Pareto distribution [Fig. 
2 (g)-(i)] Kendall Gibbons r& is again significantly more 
stable than the Pearson coefficient r, which shows a non- 
monotonic behavior [e.g., Fig. 2 (i)] and converges to zero 
with increasing h max . This adverse behavior of r further 
confirms the results recently presented in [7][S]. Hence, 
our numerical study indicates that Kendall-Gibbons' t\, 
is a more reliable association measure than the widely 
used Pearson coefficient r due to its higher robustness 
with respect to changes in network size. 
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CONCLUSIONS 



In this Brief Report, different measures for degree- 
degree association have been discussed with respect to 
their applicability to networks with a heavy-tailed de- 
gree distribution. Thereby, the network structure has 
been represented by a probability matrix allowing to dis- 
tinguish between the degree related to a given node and 
the degree related to the end of a given edge. Theoret- 
ical arguments together with our numerical study con- 
firm that the widely used Pearson coefficient is hardly 
feasible to quantify and compare degree-degree associa- 
tions in heavy-tailed networks, mainly due to its strong 
size-dependence. Our findings indicate that Kendall- 
Gibbons' Tfc is a significantly more robust measure with 
respect to the size of networks with equal association 
structure. 



FIG. 2. Values of the association measures r (squares) and 
Tt (diamonds) in relation to h max . (a) Zipf distribution with 
a — 0.5, c = 0, 7 = 1.5, (b) Zipf distribution with a = 0.6, 
c = 0.1, 7 = 2, (c) Zipf distribution with a = 0.5, c = 0.2, 7 = 
1.5, (d) Zeta distribution with a = 10, ij) = 3, r\ = 1, (e) Zeta 
distribution with a = 10, ip = 1, 77 = 1, (f) Zeta distribution 
with a = 10, ip — 3, r\ = 0.5, (g) Pareto distribution with 
9 — 0.5, 7 = 1.5, (h) Pareto distribution with 9 = 1, 7 = 1.5 
and (i) Pareto distribution with 9 — 0.5, 7=1. The dotted 
lines serve as a guide to the eye. 



ACKNOWLEDGMENTS 



M.R. acknowledges "swisselectric research" and the 
Swiss Federal Office of Energy (project No. V155269) 
for co-funding the present work. 



[1] S. N. Dorogovtsev and J. F. F. Mendes, Evolution of Net- 
works (Oxford University Press, Oxford, 2003). 

[2] A. Barrat, M. Barthelemy, and A. Vespignani, Dynamical 
Processes on Complex Networks (Cambridge University 
Press, Cambridge, 2008). 

[3] C. Castellano, S. Fortunato, and V. Loreto, Rev. Mod. 
Phys. 81, 591 (2009). 

[4] A.-L. Barabasi and R. Albert, Science 286, 509 (1999). 

[5] M. E. J. Newman, Phys. Rev. Lett. 89, 208701 (2002). 

[6] M. E. J. Newman, SIAM Rev. 45, 167 (2003). 

[7] S. N. Dorogovtsev, A. L. Ferreira, A. V. Goltsev, and 
J. F. F. Mendes, Phys. Rev. E 81, 031135 (2010). 

[8] J. Menche, A. Valleriani, and R. Lipowsky, Phys. Rev. E 
81, 046103 (2010). 

[9] G. Upton and I. Cook, Oxford Dictionary of Statistics 
(Oxford University Press, Oxford, 2008). 
[10] D. D. Mari and S. Kotz, Correlation and Dependence 

(Imperial College Press, London, 2001). 
[11] S. Weber and M. Porto, Phys. Rev. E 76, 046111 (2007). 
[12] M. Boguna and R. Pastor-Satorras, Phys. Rev. E 66, 
047104 (2002). 

[13] M. Kendall and J. D. Gibbons, Rank Correlation Methods 

(Edward Arnold, London, 1990). 
[14] L. Goodman and W. Kruskal, Journal of the American 

Statistical Association 49, 1203 (1954). 



[15] A. Stuart, Biometrica 49, 105 (1953). 

[16] H. R. Somers, American Soc. Rev. 27, 799 (1962). 

[17] M. Hollander and D. Wolfe, Nonparametric Statistical 
Methods (Wiley, New York, 2004). 

[18] J. E. Gentle, Random Number Generation and Monte 
Carlo Methods (Springer, New York, 2005). 

[19] P. Embrechts, A. McNeil, and D. Straumann, in Risk 
Management: Value at Risk and Beyond, edited by 
M. A. H. Dempster (Cambridge University Press, Cam- 
bridge, 2002) pp. 176-223. 

[20] M. Salmon and S. Hwang, An Analysis of Performance 
Measures Using Copulae, Tech. Rep. (Warwick Business 
School, 2001). 

[21] F. Lindskog, Linear Correlation Estimation, Tech. Rep. 
(RiskLab Switzerland, 2000). 

[22] B. Samra and R. H. Randies, Communications in Statis- 
tics - Theory and Methods 17, 3191 (1988). 

[23] Note that the mixing of the perfectly associated distri- 
bution with the independent distribution does not nec- 
essarily imply the mixing of a network with a perfect 
association (which does not exist) and a network with an 
independent degree-degree structure. 

[24] H.-C. Yeh, Statistics and Probability Lett. 56, 131 
(2002). 

[25] E. J. Gumbel, Journal of the American Statistical Asso- 
ciation 55, 698 (1960). 



